Camera Enhanced Off-Platter Detection System

ABSTRACT

An example object recognition and weighing apparatus for use with a POS terminal includes a weigh platter; a scale configured to measure a weight of the item when placed on the weigh platter; an off-platter detection assembly configured to detect an off-platter condition; an object recognition assembly configured to capture image data associated with the item, and based on the image data that includes non-barcode data, identify the item; a communication interface configured to communicate with the POS terminal; a processor in communication with the scale, the off-platter detection assembly, and the communication interface; and a non-transitory machine-readable storage medium storing instructions that, when executed by the processor, cause the object recognition and weighing apparatus to, responsive to detecting the off-platter condition, prevent a transmission of the identified item to the POS terminal until the off-platter condition is no longer detected.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.17/185,705, filed on Feb. 25, 2021, and incorporated herein by referencein its entirety.

BACKGROUND

One of the functions of a checkout workstation with a weighing platteris to weigh produce or other products that are priced by weight in orderto assist in determining the price of the produce or product. However,produce and products are varied in shape and size and there can beissues where part of the produce or product sits off of the weighplatter, resulting in incorrect weight measurement and, therefore,incorrect pricing. Therefore, there is a need to be able to identifywhen produce or products being weighed on a weighing platter of acheckout workstation extend off of the weigh platter during the weighingprocess in order to reduce or eliminate instances of incorrect weightmeasurement and allow the user to identify and correct the problembefore a price for the produce or products is calculated so thatweight-based pricing will be accurate.

SUMMARY

In an embodiment, the present invention is an object recognition andweighing apparatus for use with a point of sale (POS) terminal that isoperable to execute a transaction associated with a purchase of an item,the object recognition and weighing apparatus comprising: a weighplatter having a first surface extending in a first transverse plane; ascale configured to measure a weight of the item when placed on thesurface; an off-platter detection assembly configured to detect anoff-platter condition and a no-off-platter condition; an objectrecognition assembly configured to capture image data associated withthe item when placed on the surface and, based on the image data thatincludes non-barcode data, identify the item as an identified item set,the identified item set including one or more items selected from apreexisting item database where the one or more items are selected basedsatisfying a predetermined similarity threshold relative to the item; acommunication interface configured to communicate with the POS terminal;a processor in communication with the scale, the off-platter detectionassembly, and the communication interface; and a non-transitorymachine-readable storage medium storing instructions that, when executedby the processor, cause the object recognition and weighing apparatusto: responsive to detecting the off-platter condition, prevent atransmission of the identified item set to the POS terminal; andresponsive to detecting the no-off-platter condition, enable thetransmission of the identified item set to the POS terminal, wherein theoff-platter detection assembly is configured to detect the off-plattercondition based on at least one of (i) a portion of the item resting ona second surface off the weigh platter resulting or (ii) at least someportion of the item extending beyond a perimeter of the weigh platter,and wherein the off-platter detection assembly is further configured todetect the no-off-platter condition based on at least one of (i) noportion of the item resting on the second surface off the weigh platteror (ii) no portion of the item extending beyond the perimeter of theweigh platter.

In a variation of this embodiment, detecting a no-off-platter conditionis a default mode of operation of the off-platter detection assembly.

In another embodiment, the present invention is an object recognitionand weighing apparatus for use with a point of sale (POS) terminal thatis operable to execute a transaction associated with a purchase of anitem, the object recognition and weighing apparatus comprising: a weighplatter having a first surface extending in a first transverse plane; ascale configured to measure a weight of the item when placed on thesurface; an object classification identification system configured todetermine if the item is a high-priority item or a non-high-priorityitem; an off-platter detection assembly configured to detect anoff-platter condition and a no-off-platter condition; an objectrecognition assembly configured to capture image data associated withthe item when placed on the surface and, based on the image data thatincludes non-barcode data, identify the item as an identified item set,the identified item set including one or more items selected from apreexisting item database where the one or more items are selected basedsatisfying a predetermined similarity threshold relative to the item; acommunication interface configured to communicate with the POS terminal;a processor in communication with the scale, the off-platter detectionassembly, and the communication interface; and a non-transitorymachine-readable storage medium storing instructions that, when executedby the processor, cause the object recognition and weighing apparatusto: responsive to detecting the item being the high-priority item, (i)prevent a transmission of the identified item set to the POS terminalwhen the off-platter condition is detected and (ii) enable thetransmission of the identified item set to the POS terminal when theno-off-platter condition is detected; responsive to detecting the itembeing the non-high-priority item, enable the transmission of theidentified item set to the POS without regard for whether theoff-platter condition or the no-off-platter condition is present,wherein the off-platter detection assembly is configured to detect theoff-platter condition based on at least one of (i) a portion of the itemresting on a second surface off the weigh platter resulting or (ii) atleast some portion of the item extending beyond a perimeter of the weighplatter, and wherein the off-platter detection assembly is furtherconfigured to detect the no-off-platter condition based on at least oneof (i) no portion of the item resting on the second surface off theweigh platter or (ii) no portion of the item extending beyond theperimeter of the weigh platter.

In a variation of this embodiment, detecting a no-off-platter conditionis a default mode of operation of the off-platter detection assembly.

In yet another embodiment, the present invention is an objectrecognition and weighing apparatus for use with a point of sale (POS)terminal that is operable to execute a transaction associated with apurchase of an item, the object recognition and weighing apparatuscomprising: a weigh platter having a first surface extending in a firsttransverse plane; a scale configured to measure a weight of the itemwhen placed on the surface; an off-platter detection assembly configuredto detect an off-platter condition; an object recognition assemblyconfigured to capture image data associated with the item when placed onthe surface and, based on the image data that includes non-barcode data,identify the item as an identified item set, the identified item setincluding one or more items selected from a preexisting item databasewhere the one or more items are selected based satisfying apredetermined similarity threshold relative to the item; a communicationinterface configured to communicate with the POS terminal; a processorin communication with the scale, the off-platter detection assembly, andthe communication interface; and a non-transitory machine-readablestorage medium storing instructions that, when executed by theprocessor, cause the object recognition and weighing apparatus to,responsive to detecting the off-platter condition, prevent atransmission of the identified item set to the POS terminal until theoff-platter condition is no longer detected, wherein the off-platterdetection assembly is configured to detect the off-platter conditionbased on at least one of (i) a portion of the item resting on a secondsurface off the weigh platter resulting or (ii) at least some portion ofthe item extending beyond a perimeter of the weigh platter.

In still yet another embodiment, the present invention is an objectrecognition and weighing apparatus for use with a point of sale (POS)terminal that is operable to execute a transaction associated with apurchase of an item, the object recognition and weighing apparatuscomprising: a weigh platter having a first surface extending in a firsttransverse plane; a scale configured to measure a weight of the itemwhen placed on the surface; an object classification identificationsystem configured to detect the item as a high-priority item; anoff-platter detection assembly configured to detect an off-plattercondition; an object recognition assembly configured to capture imagedata associated with the item when placed on the surface and, based onthe image data that includes non-barcode data, identify the item as anidentified item set, the identified item set including one or more itemsselected from a preexisting item database where the one or more itemsare selected based satisfying a predetermined similarity thresholdrelative to the item; a communication interface configured tocommunicate with the POS terminal; a processor in communication with thescale, the off-platter detection assembly, and the communicationinterface; and a non-transitory machine-readable storage medium storinginstructions that, when executed by the processor, cause the objectrecognition and weighing apparatus to: responsive to (i) detecting theitem being the high-priority item and (ii) detecting the off-plattercondition, prevent a transmission of the identified item set to the POSterminal until the off-platter condition is no longer detected, whereinthe off-platter detection assembly is configured to detect theoff-platter condition based on at least one of (i) a portion of the itemresting on a second surface off the weigh platter resulting or (ii) atleast some portion of the item extending beyond a perimeter of the weighplatter.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying figures, where like reference numerals refer toidentical or functionally similar elements throughout the separateviews, together with the detailed description below, are incorporated inand form part of the specification, and serve to further illustrateembodiments of concepts that include the claimed invention, and explainvarious principles and advantages of those embodiments.

FIG. 1 illustrates a block diagram of an example system including alogic circuit for implementing the example methods and/or operationsdescribed herein, including methods for improving the effectiveness ofoff-platter detection systems based on input from object recognitionsystems.

FIG. 2 illustrates a front perspective view of a first example checkoutworkstation having an off-platter detection assembly with a firstexample off-platter indication system.

FIG. 3 illustrates a top view of the checkout workstation of FIG. 2 withan object extending across a first lateral edge of the weigh platter.

FIG. 4 illustrates a front perspective view of a second example checkoutworkstation having an off-platter detection assembly with a secondexample off-platter indication system.

FIG. 5 illustrates a front view of the checkout workstation of FIG. 4with an object extending across a first lateral edge of the weighplatter.

FIG. 6 illustrates a side view of the checkout workstation of FIG. 2with one example off-platter detection assembly.

FIG. 7 illustrates a top view of the checkout workstation of FIG. 6 withan object extending across a first lateral edge of the weigh platter.

FIG. 8 illustrates a side view of the checkout workstation of FIG. 4with another example off-platter detection assembly.

FIG. 9 illustrates a front view of the checkout workstation of FIG. 8with an object extending across a first lateral edge of the weighplatter.

FIG. 10 illustrates a side view of a third example checkout workstationhaving an off-platter detection assembly with a third exampleoff-platter indication system.

FIG. 11 illustrates a front view of the checkout workstation of FIG. 10with an object extending across a first lateral edge of the weighplatter.

FIG. 12 illustrates a block diagram of an example process as may beimplemented by the system of FIG. 1 , for implementing example methodsand/or operations described herein, including methods for improving theeffectiveness of an off-platter detection system based on input from anobject recognition system.

FIG. 13 illustrates a block diagram of an example process as may beimplemented by the system of FIG. 1 , for implementing example methodsand/or operations described herein, including methods for improving theeffectiveness of an off-platter detection system based on input from anobject recognition system indicating a priority level associated with anitem to be purchased.

Skilled artisans will appreciate that elements in the figures areillustrated for simplicity and clarity and have not necessarily beendrawn to scale. For example, the dimensions of some of the elements inthe figures may be exaggerated relative to other elements to help toimprove understanding of embodiments of the present invention.

The apparatus and method components have been represented whereappropriate by conventional symbols in the drawings, showing only thosespecific details that are pertinent to understanding the embodiments ofthe present invention so as not to obscure the disclosure with detailsthat will be readily apparent to those of ordinary skill in the arthaving the benefit of the description herein.

DETAILED DESCRIPTION

The present disclosure generally relates to checkout workstations havingoff-platter detection systems that can be used to detect instances ofoff-platter conditions, in which at least a portion of an item to bepurchased is not resting on the weighing platter of the checkoutworkstation. With the increasing trend for vision cameras to beinstalled in or around bioptic checkout workstations for objectrecognition purposes, it is possible to improve the effectiveness ofoff-platter detection systems based on input from object recognitionsystems. For instance, in one example, the present disclosure provides asystem and method in which the behavior of an object recognition systemis modified based on signals from the off-platter detection system, suchthat the object recognition system is activated in response todetermining that any instance of off-platter conditions are resolved,and an indication of the identified object is then sent to the POSsystem. In another example, the present disclosure provides a system andmethod in which the object recognition system proceeds normally in adefault mode (i.e., the default mode is that there are no off-platterconditions) unless an instance of an off-platter condition is detected,in which the indication of the identified object is prevented from beingsent to the POS system. In another example, the present disclosureprovides a system and method in which the behavior of the off-platterdetection system is modified based on signals from the objectrecognition system, such that the off-platter detection system isactivated in response to a priority level of an item to be purchasedidentified by the object recognition system, and an indication of theidentified object is sent to the POS once any off-platter conditions areresolved. For instance, in some examples, the off-platter detectionsystem may only be activated for high-price items, controlled items(such as alcohol, cigarettes, medications, etc.), or items that areotherwise frequently stolen.

In any case, any off-platter conditions detected by the off-platterdetection system must be resolved before an indication of the identifiedobject is sent to the POS system, i.e., such that the price of an itemthat is priced by weight cannot be calculated until off-platterconditions are resolved. That is, while the current weight measured bythe weighing scale is monitored at all times, it is not possible todetermine the price of a given object without both a weight of the itemand an identification of the item.

In some examples, resolving off-platter conditions may include using anoff-platter indication system that provides a user with an alert thatthere may be an off-platter event, and/or provides the user with anindication of the location of the off-platter event, which allows theuser to quickly and easily identify and correct the potentialoff-platter event. The off-platter indication systems herein can be usedwith various types of off-platter detection systems, such as infrared(IR) systems, light detection and ranging (LIDAR) systems, camera basedsystems, beam breaking systems, light only systems, etc., to indicate tothe user whether the potential off-platter event is on a left side,right side, or end of the weigh platter and where along the indicatedside the off-platter event is occurring.

FIG. 1 illustrates a block diagram of an example checkout workstationsystem 1100 including a logic circuit for implementing the examplemethods and/or operations described herein, including methods forimproving the effectiveness of off-platter detection systems based oninput from object recognition systems. The system 1100 may include aweighing scale 1102, an off-platter detection system 1104, an objectrecognition system 1106, and a POS system 1108. The weighing scale 1102,off-platter detection system 1104, object recognition system 1106, andPOS system 1108 may each communicate with one another via a wired orwireless network 1110.

The weighing scale 1102 (e.g., such as the weigh platter assembly 100discussed in greater detail below) may monitor the weight of itemsplaced on a weighing platter associated with the checkout workstationand may continuously or periodically log and send the monitored weightsto the POS system 1108, e.g., via the network 1110.

The off-platter detection system 1104 (also called an off-platterdetection assembly, as discussed in greater detail with respect to FIGS.2-11 ) is generally configured to detect instances of off-platterconditions in which at least a portion of an item to be purchased is notresting on the weighing platter. In some examples, the off-platterdetection system 1104 may display alerts or notifications to users wheninstances of off-platter conditions are detected, or may sendindications of instances of off-platter conditions to the POS system,e.g., via the network 1110, to be displayed to the user. In someexamples, the off-platter detection system 1104 may send indications ofsuch instances to the object recognition system 1106, e.g., via thenetwork 1110. Additionally, in some examples, the off-platter detectionsystem 1104 may receive indications of priority levels associated withitems to be purchased on or around the weighing platter as identified bythe object recognition system 1106. For instance, in some examples, theoff-platter detection system 1104 may be activated to monitor forinstances of off-platter conditions only when a priority levelassociated with an item to be purchased is above a threshold prioritylevel, and may not monitor for instances of off-platter conditions whenthe priority level associated with the item to be purchased is below thethreshold priority level.

The object recognition system 1106 may be configured to capture imagesof items to be purchased that are placed on the weighing platterassociated with the checkout workstation using one or more cameras 1112.In some examples, one or more of the cameras 1112 may be furtherconfigured to capture images of users of the checkout workstation 1100.The object recognition system 1106 may further include one or moreprocessors 1114 and a memory 1116 (e.g., volatile memory, non-volatilememory) accessible by the one or more processors 1114 (e.g., via amemory controller). The one or more processors 1114 may interact withthe memory 1116 to obtain, for example, computer-readable instructionsstored in the memory 1116. The computer-readable instructions stored inthe memory 1116, when executed by the one or more processors 1114, maycause the one or more processors 1114 to analyze the captured images inorder to identify each item to be purchased and send indications ofidentified items to the POS system 1108, e.g., via the network 1110. Insome examples, identifying each item may mean determining severalpossible identifications for each item, and sending indications of thepossible identifications for each item to the POS system 1108, so that auser of the POS system 1108 can select which possible identification iscorrect. In some examples, the computer-readable instructions stored onthe memory 1116 may include instructions for identifying priority levelsassociated with each item to be purchased, and sending indications ofidentified priority levels associated with each item to be purchased tothe off-platter detection system 1104, e.g., via the network 1110. Forinstance, the priority level of an item may be based on one or more of:a total price associated with the item, a price per unit weightassociated with the item, whether the item is a controlled item (e.g.,alcohol, cigarettes, certain medications, etc.), and/or a high theftpotential associated with the item. For example, determining that a hightheft potential is associated with an item may be based on frequentobservations of ticket switching associated with the item and/orfrequent observations of scan avoidance associated with the item. Whenthere are multiple possible identifications of a given item, thepriority level sent to the off-platter detection system 1104 may be thehighest of the possible priority levels associated with each possibleidentification of the item.

Moreover, in some examples, the computer-readable instructions stored onthe memory 1116 may include instructions for receiving indications ofinstances of off-platter conditions detected by the off-platterdetection system 1104, and only capturing images, analyzing capturedimages to identify items to be purchased, and sending indications ofidentified items to the POS system 1108 when no off-platter conditionsare detected by the off-platter detection system 1104 or once anyoff-platter conditions detected by the off-platter detection system 1104are resolved.

Additionally, the computer-readable instructions stored on the memory1116 may include instructions for carrying out any of the steps of themethod 1200, described in greater detail below with respect to FIG. 12 ,or the steps of method 1300, described in greater detail below withrespect to FIG. 13 .

The POS system 1108 may be configured to calculate prices of items to bepurchased by users, based on receiving an identification of the item asdetermined by the object recognition system 1106 and based on the weightmeasured by the weighing scale 1102 at the time that the POS system 1108receives the identification of the item. The POS system 1108 may includea user interface 1118 configured to receive input from users and provideinformation to users. The POS system 1108 may further include one ormore processors 1120 and a memory 1122 (e.g., volatile memory,non-volatile memory) accessible by the one or more processors 1120(e.g., via a memory controller). The one or more processors 1120 mayinteract with the memory 1122 to obtain, for example, computer-readableinstructions stored in the memory 1122. The computer-readableinstructions stored in the memory 1122, when executed by the one or moreprocessors 1120, may cause the one or more processors 1120 to monitorthe current weight measured by the weighing scale 1102, e.g., based ondata sent from the weighing scale 1102 to the POS system 1108 via thenetwork 1110. Furthermore, the computer-readable instructions stored onthe memory 1122 may further include instructions for receivingindications of one or more possible identifications of items to bepurchased from the object recognition system 1106, e.g., via the network1110, and calculating a weight-based price for each item to be purchasedbased on the identification of the item and the weight measured by theweighing scale 1102 at the time when the POS system 1108 receives theindication of the identification of the item. That is, thecomputer-readable instructions stored on the memory 1122 may cause thePOS system 1108 to access a database listing prices per unit weight forthe identified item, and may calculate the price of the item based onthe price per weight and the weight at the time when the indication ofthe identification of item is received. When the POS system 1108receives multiple possible identifications for the item, the POS system1108 may display the possible identifications to a user via the userinterface 1118, such that a user may select which of the possibleidentifications is correct, and may calculate the price for the itemonce the user selects a possible identification.

Additionally, in some examples, the computer-readable instructionsstored on the memory 1122 may further include instructions for receivingindications of instances of off-platter conditions from the off-platterdetection system 1104, e.g., via the network 1110, and displayingnotifications to the user indicating that there is an off-plattercondition, indicating possible ways that the user can correct theoff-platter condition, etc.

Furthermore, the computer-readable instructions stored on the memory1122 may include instructions for carrying out any of the steps of themethod 1200, described in greater detail below with respect to FIG. 12 ,or the steps of method 1300, described in greater detail below withrespect to FIG. 13 .

Referring to FIGS. 2-3 , a first example checkout workstation 10, suchas the Zebra® MP7000 bioptic barcode reader, is shown and can beconfigured to be supported by a checkout counter 50 at a POS of a retailstore. Checkout workstation 10 has a housing 15 that includes a lowerhousing 20 that houses a weigh platter assembly 100 and an upper housing30 that extends above lower housing 20. Upper housing 30 includes agenerally vertical window 35 to allow a first set of optical componentspositioned within housing 15 to direct a first field-of-view throughvertical window 35. In addition, if the checkout workstation 10 is abioptic barcode reader, lower housing 20 will include a generallyhorizontal window 25, which in the example shown is positioned in aweigh platter 105 of weigh platter assembly 100 to allow a second set ofoptical components positioned within housing 15 to direct a second fieldof view through horizontal window 25. The first and second fields ofview intersect to define a product scanning region 40 of checkoutworkstation 10 where a product can be scanned for sale at the POS.

Weigh platter assembly 100 generally includes a weigh platter 105 thatis positioned within lower housing 20 and is configured to measure theweight of an object placed on weigh platter 105. Weigh platter 105 hasupper surface 110 that faces product scanning region 40, a proximal edge115, a first lateral edge 120, a second lateral edge 125, and a distaledge 130. In the example shown, proximal edge 115 is adjacent upperhousing 30 and would be the edge furthest from a user of weigh platterassembly 100 and/or checkout workstation 10. First lateral edge 120extends non-parallel to proximal edge 115. Second lateral edge 125 isopposite first lateral edge 120 and extends non-parallel to proximaledge 115. Distal edge 130 is opposite proximal edge 115, would be theedge closest to the user, and extends non-parallel to first and secondlateral edges 120, 125. In the example shown, weigh platter is generallyrectangular and first and second lateral edges 120, 125 are parallel andperpendicular to proximal edge 115 and distal edge 130 and distal edgeis parallel to proximal edge 115.

The checkout workstation 10 in FIGS. 2-3 also includes an off-platterdetection assembly with a first example off-platter indication system200, which has a plurality of linearly aligned light sources 405 thateach represent a location along first lateral edge 120 of weigh platter105. In the example shown, light sources 405 can be any type of lightsource, such as light emitting diodes, and are positioned in uppersurface 110 of weigh platter 105 and generally aligned along firstlateral edge 120. In the example shown, light sources 405 are spread outalong the entire length of weigh platter 105, however, light sources 405can also be grouped closely together and positioned adjacent distal edge130 of weigh platter 105 so that light sources 405 are easily viewableby a user and the chance that an object being weighed would obscurelight sources 405 from the view of the user would be reduced. Forsimplicity, only light sources 405 along first lateral edge 120 aredescribed herein, however, it will be understood that off-platterindication system 400 can also include a second plurality of linearlyaligned light sources 405A along second lateral edge 125 to provide anindication of a potential off-platter event and the location of thepotential off-platter event along second lateral edge 125. Theoff-platter detection assembly also has a controller 290 that isconfigured to determine if an object 60 (FIG. 3 ) extends over firstlateral edge 120 of weigh platter 105 and, if so, determine the locationof object 60 along first lateral edge 120, as described in more detailbelow. If controller 290 determines that object 60 extends over firstlateral edge 120, controller 290, which is operatively coupled to lightsources 405, is configured to illuminate a first portion 410 of lightsources 405 located between object 60 and proximal edge 115 of weighplatter 105 to represent the distance between proximal edge 115 and thelocation that object 60 crosses first lateral edge 120 and tode-illuminate a second portion 415 of light sources 405 located betweenobject 60 and distal edge 130 of weigh platter 105 to represent thedistance between the location that object 60 crosses first lateral edge120 and distal edge 130. The de-illumination of second portion 415 oflight sources 405 alerts the user that there is a potential off-platterevent along first lateral edge 120 and the illumination of the firstportion 410 of light sources 405 identifies to the user the location ofthe potential off platter event. In addition, off-platter indicationsystem can have a speaker or other audio device that can also provideaudio notifications informing the user where the potential off-platterevent is occurring (e.g., left side, right side, left side near upperhousing, right side near end of platter, etc.).

Referring to FIGS. 4-5 , a second example checkout workstation 10A isillustrated that is the same as checkout workstation 10, but includes anoff-platter detection assembly with a second example off-platterindication system 450, rather than off-platter indication system 400.Off-platter indication system 450 is similar to off-platter indicationsystem 400 in that off-platter indication system 450 has a plurality oflinearly aligned light sources 455 that each represent a location alongfirst lateral edge 120 of weigh platter 105. In the example shown, lightsources 405 can be any type of light source, such as light emittingdiodes, and are positioned in upper housing 30 and are generally alignedwith first lateral edge 120 of weigh platter 105 and directed towardsdistal edge 130 so they are visible by a user. In the example shown,light sources 455 are spread out along the entire height of upperhousing 30, however, light sources 455 can also be grouped closelytogether and positioned adjacent the top of upper housing 30 so thatlight sources 455 are easily viewable by a user and the chance that atall object being weighed would obscure light sources 455 from the viewof the user would be reduced. Again, for simplicity, only light sources455 aligned with first lateral edge 120 are described herein, however,it will be understood that off-platter indication system 450 can alsoinclude a second set of light sources 455A aligned with second lateraledge 125 to provide an indication of a potential off-platter event andthe location of the potential off-platter event along second lateraledge 125. The off-platter detection assembly also has a controller 350that is configured to determine if an object 60 (FIG. 5 ) extends overfirst lateral edge 120 of weigh platter 105 and, if so, determine thelocation of object 60 along first lateral edge 120, as described in moredetail below. If controller 350 determines that object 60 extends overfirst lateral edge 120, controller 350, which is operatively coupled tolight sources 455, is configured to illuminate a first portion 460 oflight sources 455 to represent the distance between proximal edge 115and the location that object 60 crosses first lateral edge 120 and tode-illuminate a second portion 465 of light sources 455 to represent thedistance between the location that object 60 crosses first lateral edge120 and distal edge 130. The de-illumination of second portion 465 oflight sources 455 alerts the user that there is a potential off-platterevent along first lateral edge 120 and the illumination of the firstportion 460 of light sources 455 identifies to the user the location ofthe potential off platter event.

FIGS. 6-7 illustrate a checkout workstation 10 with an off-platterindication system 400 and one particular example of an off-platterdetection assembly 200, which in the example shown is a LIDAR basedsystem. The example off-platter detection assembly 200 generallyincludes a light emission assembly 205, a light detection assembly 250,and controller 290 operatively coupled to light emission assembly 205and light detection assembly 250. For simplicity, only a single lightemission assembly 205 and light detection assembly 250 along firstlateral edge 120 are described herein, however, it will be understoodthat off-platter detection assembly 200 can also include a second lightemission assembly and a second light detection assembly on an oppositeside to detect objects that extend over second lateral edge 125, asshown in FIG. 7 .

Light emission assembly 205 can be located within upper housing 30 ofhousing 15, has a light source 210, and is configured to emit pulses oflight 215 away from proximal edge 115, towards distal edge 130, andalong first lateral edge 120 of weigh platter 105. Light source 210could be an LED that is focused into a narrow beam, similar to an aimingdot used in scanners, a focused laser beam, etc., and could be on theinfrared wavelength, visible light wavelength, or any wavelengthdesired. Light source 210 can have a field-of-view 212 and lightemission assembly 205 can also include an aperture 220, which could beformed in a wall or protrusion of housing 15 or could be formed throughanother wall or structure that is part of weigh platter assembly 100,positioned in front of light source 210 to constrain field-of-view 212of light source 210 into a narrow field-of-view 230 along first lateraledge 120. A lens 225 can also be positioned in front of aperture 220 andconfigured to focus the one or more pluses of light 215. In addition,although off-platter detection assembly 200 does not require any bumpsor physical barriers at distal edge 130 of weigh platter 105, ifdesired, a barrier can be positioned at distal edge 130, opposite lightemission assembly 205, and can be made of a material and/or color thatis absorptive to the wavelength of the pulses of light 215 to preventreflection of the pulses of light 215 from objects or users that arebeyond distal edge 130.

Light detection assembly 250 can also be located within housing 15 andhas a field-of-view 255, with a central field-of-view axis 260 that issubstantially adjacent to and parallel relative to first lateral edge120, that extends from proximal edge 115 to at least distal edge 130 andalong first lateral edge 120. Light detection assembly 250 has a lightsensor 265 that is configured to detect at least a portion of the pulsesof light 215 that are reflected from an object 60 that extends acrossthe path of the pulses of light 215, and therefore off weigh platter105, towards proximal edge 115 and within field-of-view 255. To restrictfield-of-view 255, light sensor 265 can be set deep within housing 15 orthe path of field-of-view 255 can be folded with reflectors or prisms tolocate light sensor 265 wherever needed inside housing 15. The deepinset of light sensor 265 helps light sensor 265 remain immune to otheroutside light sources. Light sensor 265 can have a second field-of-view270 that is larger than field-of-view 255 of light detection assembly250 and an aperture 280, which could be formed in a wall or protrusionof housing 15 or could be formed through another wall or structure thatis part of weigh platter assembly 100, can be positioned in front oflight sensor 265 to constrain field-of-view 270 of light sensor 265,where a center of aperture 280 is coaxial with a central field-of-viewaxis 275 of field-of-view 270 of light sensor 265. In addition, a lens285 can also be positioned in front of aperture 280 and configured tofocus the reflected portion of the pulses of light 215 onto light sensor265. For example, aperture 280 can be 1 millimeter or smaller and bepositioned 3 inches back from lens 285, which will provide amagnification of approximately 400% at distal edge 130 of weigh platter105.

In addition to controlling the illumination and de-illumination of lightsources 405, controller 290 is also configured to measure atime-of-flight of a pulse of light reflected from an object 60 (FIG. 7). The time-of-flight is the time elapsed from when the pulse of lightis emitted by light emission assembly 205 to when at least a portion ofthe pulse of light is reflected back to light detection assembly 250 anddetected by light sensor 265. Controller 290 can also be configured todetermine if object 60 extends across first lateral edge 120 and off ofweigh platter 105 by determining if the time-of-flight of the reflectedportion of the pulse of light is equal to or greater than apredetermined time-of-flight, which is the predetermined time elapsedfrom when a light pulse is emitted by light emission assembly 205 towhen at least a portion of the pulse of light is reflected back to lightdetection assembly 250 from an object that located at distal edge 130 ofweigh platter 105 and detected by light sensor 265. If a measuredtime-of-flight is equal to or greater than the predeterminedtime-of-flight, or if a pulse of light is not reflected back to lightdetection assembly 250, this indicates that there is no object extendingacross first lateral edge 120 between proximal edge 115 and distal edge130 and controller 290 can be configured to allow the measure weight ofthe object to be recorded. If the measured time-of-flight is less thanthe predetermined time-of-flight this indicates that object 60 isextending across first lateral edge 120 between proximal edge 115 anddistal edge 130 and, in addition to illuminating and de-illuminatinglight sources 405 as described above, controller 290 can also beconfigured to prevent the measured weigh of object 60 from beingrecorded. Controller 290 can also be configured to determine thelocation of object 60 along first lateral edge 120 based on thetime-of-flight. The shorter the time-of-flight, the closer object 60 isto light sensor 265 and, therefore, to proximal edge 115. The longer thetime-of-flight, the further object 60 is from light sensor 265 and,therefore, from proximal edge 115.

In operation, light emission assembly 205 of off-platter detectionassembly 200 emits pulses of light 215 from light source 210 along firstlateral edge 120 of weigh platter 105. Light detection assembly 250 hasfield-of-view 255 along first lateral edge 120. When an object 60extends across the path of the pluses of light 215, and therefore offweigh platter 105, a portion of the pulses of light 215 are reflectedfrom object 60 and towards light sensor 265 and light sensor 265 detectsthe portion of the pulses of light 215 reflected from object 60.Controller 290 receives a signal from light sensor 265 indicating thatreflected light from object 60 has been detected and either a time thereflected light was detected. Depending on the time-of-flight,controller 290 then determines if object 60 extends across first lateraledge 120 and off weigh platter 105 and, if so, the location that object60 extends across first lateral edge 120, as discussed above.

FIGS. 8-9 illustrate a checkout workstation 10A with an off-platterindication system 450 and one particular example of an off-platterdetection assembly 300, which in the example shown is a camera basedsystem. In this example, off-platter detection assembly 300 generallyincludes an overhead imaging assembly 305 and controller 350 operativelycoupled to overhead imaging assembly 305, which is positionedsubstantially above weigh platter 105 and looks down on weigh platter105. Positioning overhead imaging assembly 305 above and looking down onweigh platter 105 locates overhead imaging assembly 305 far enough abovetall items being weighted so as to reduce the chance that a tall objectwould falsely trigger off-platter detection assembly 300. Overheadimaging assembly 305 can be an imaging assembly that is dedicated tooff-platter detection assembly 300 or an imaging assembly that isalready part of the checkout workstation 10 and used for objectrecognition and is positioned above and looking down on weigh platter105. Overhead imaging assembly 305 includes an imager 310, preferably a2 mega pixel camera, that has a field-of-view 315 that extends downwardtowards upper surface 110 of weigh platter 105 and is configured tocapture an image of upper surface 110 of weigh platter 105 with object60 located on weigh platter 105, including first lateral edge 120 andsecond lateral edge 125, within field-of-view 315. Field-of-view 315 hasa proximal boundary 320, a distal boundary 325, opposite proximalboundary 320, a first lateral boundary 330, and a second lateralboundary 335, opposite first lateral boundary 330. To provide themaximum amount of lateral coverage of upper surface 110, field-of-view315 preferably has a transverse field-of-view angle B between firstlateral boundary 330 and second lateral boundary 335 that is within therange of 100 degrees and 135 degrees.

In the example shown, the checkout workstation 10A includes a gooseneckpost 70 that extends from a back of housing 15 and extends over weighplatter 105 and overhead imaging assembly 305 is positioned withingooseneck post 70 such that a central axis 340 of field-of-view 315extends generally perpendicular to upper surface 110 of weigh platter105. Alternatively, rather than being positioned within gooseneck post70, overhead imaging assembly 305 could be mounted or positioned in anyposition above and looking down on weigh platter 105, such as in aceiling or as part of an overhead object recognition system or securitysystem overlooking weigh platter 105. To provide the maximum amount oflongitudinal coverage of upper surface 110, overhead imaging assembly305 can be positioned such that proximal boundary 320 of field-of-view315 intersects upper surface 110 of weigh platter 105 at orsubstantially adjacent proximal edge 115 (e.g., within the range of 0-30mm of proximal edge 115) and distal boundary 325 extends to or beyonddistal edge 130.

Controller 350 can be calibrated initially (at the factory or duringinstallation or final testing) by being configured to identify andlocate first lateral edge 120 and second lateral edge 125 based on atraining image of upper surface 110 of weigh platter 105 withinfield-of-view 315. The training image is an image of upper surface 110of weigh platter 105 without an object placed on weigh platter 105 andfirst lateral edge 120 and second lateral edge 125 within field-of-view315. For example, the location of the first and second lateral edges120, 125 can be identified by a user observing the training image bydrawing or indicating lies on the training image using a configurationtool or the first and second lateral edges 120, 125 could be detectedautomatically by controller 350.

In addition to controlling the illumination and de-illumination of lightsources 455, controller 350 is also configured to receive an image fromimager 310 and determine if an object 60 (FIG. 9 ) positioned on weighplatter 105 extends over first or second lateral edges 120, 125 and, ifso, determine the location of object 60 along first lateral or secondlateral edge 120, 125 based on the image. Controller 350 can beconfigured to determine if and where object 60 extends over first orsecond lateral edges 120, 125 by determining if part of the first orsecond lateral edges 120, 125 or the gap between weigh platter 105 andlower housing 20 or workstation 50, determined during calibration basedon the training image, is blocked or not visible. Controller 350 canalso use a convolutional neural network (CNN) to determine whetherobject 60 extends over first or second lateral edges 120, 125, forexample, by identifying object 60 and its orientation and comparing itagainst a database of dimensional data to determine whether object 60crosses first or second lateral edges 120, 125. If controller 350determines that object 60 does not extend over either first or secondlateral edges 120, 125, controller 350 can be configured to allow themeasured weight of object 60 to be recorded. If controller 350determines that object 60 does extend over first lateral edge 120 and/orsecond lateral edge 125, in addition to the illumination andde-illumination of light sources 455 as described above, controller 350can be configured to prevent the measured weight of object 60 from beingrecorded.

Referring to FIGS. 10-11 , a third example checkout workstation 1013 isillustrated that is the same as checkout workstation 10A withoff-platter detection assembly 300 described above and shown in FIGS.8-9 , but includes a third example off-platter indication system 500,rather than off-platter indication system 450. In checkout workstation10B, off-platter indication system 500 is in communication withcontroller 350 and has a visual display 505, which could be a display ofcheckout workstation 1013, a display or monitor that is separate fromand in communication with checkout workstation 1013, or a display of apoint-of-sale system operatively coupled to checkout workstation 1013.In this example, if controller 350 determines that object 60 does extendover first lateral edge 120 and/or second lateral edge 125, rather thancontrolling the illumination and de-illumination of light sources 455,controller 350 can be configured to display a platter representation 510on visual display 505 with an indication 515 of the location whereobject 60 extends over first and/or second lateral edges 120, 125.Platter representation 510 can be a live video feed that controller 350receives from overhead imaging assembly 305, a photographicrepresentation of weigh platter 105, or a drawing or rendering of weighplatter 105. As shown, indication 515 is an arrow that points to thelocation that object 60 extends across first and/or second lateral edges120, 125, but indication 515 could be any indicator that wouldcommunicate to the user the location, such as highlighting a portion ofweigh platter 105 where the off-platter event is occurring. In additionto providing the an alert to a user on visual display 505, controller350 can also be configured to allow the measure weight of object 60 tobe recorded if controller 350 determines that object 60 does not extendover either first or second lateral edges 120, 125 and prevent themeasured weight of object from being recorded if controller 350determines that object 60 does extend over either first or secondlateral edges 120, 125.

Furthermore, since field-of-view 315 of overhead imaging assembly 305encompasses the entire weigh platter 105, including distal edge 130, inaddition to determining if object 60 extends over first or secondlateral edges 120, 125, controller 350 can be configured to determine ifobject 60 extends over distal edge 130 based on the image and, if so,determine a location where object 60 extends over distal edge 130. Ifcontroller 350 determines that object 60 extends over distal edge 130,off-platter indication system 500 can display platter representation 510on visual display 505 with indication 515 of the location where object60 extends over distal edge 130 displayed in platter representation 510.In addition to providing the an alert to a user on visual display 505,controller 350 can also be configured to allow the measure weight ofobject 60 to be recorded if controller 350 determines that object 60does not extend over distal edge 130 and prevent the measured weight ofobject from being recorded if controller 350 determines that object 60does extend over distal edge 130.

FIG. 12 illustrates a block diagram of an example process 1200 as may beimplemented by the system of FIG. 1 , for improving the effectiveness ofan off-platter detection system based on input from an objectrecognition system. One or more steps of the method 1200 may beimplemented as a set of instructions stored on a computer-readablememory (e.g., memory 1116 and/or memory 1122) and executable on one ormore processors (e.g., processors 1114 and/or processors 1120).

At block 1202, the weight measured by a weighing scale or weighingplatter associated with a POS system may be monitored. The measuredweight may fluctuate as an item to be purchased is placed onto theweighing platter, i.e., depending on whether the item to be purchased isfully resting on the weighing platter or not.

At block 1204, the weighing platter may be monitored for any instancesof off-platter conditions, in which at least a portion of an item to bepurchased using the POS system is not resting on the weighing platter.For instance, examples of off-platter conditions may include aconditions in which an item to be purchased is only partially resting onthe weighing platter, conditions in which items to be purchased are inmotion and not settled on the weighing platter, conditions in a bag ofitems to be purchased (such as apples or oranges) are spilling over thesides of the weighing platter, etc. In some examples, if an off-plattercondition is detected, a message may be provided to a user of thecheckout station indicating that the user must resolve the off-plattercondition in order to proceed. For instance, the message may be providedvia, e.g., a user interface, a voice instruction over a speaker, anerror beep, an LED flash, etc.

Additionally, in some examples, if an off-platter condition is detected,an image or video of the weighing platter, and/or an image of the userof the checkout station, may be captured. This image or video may beanalyzed to determine a location or direction associated with theportion of the item to be purchased using the POS system that is notresting on the weighing platter, and the message provided to the userregarding resolving the off-platter condition may include an indicationof the determined location or direction, i.e., so that the user knowshow best to resolve the off-platter condition. For instance, the messageprovided to the user may indicate that the item is falling off of theweighing platter on the left side, so that the user can check the leftside of the weighing platter and move the item onto the weighingplatter.

In some examples, additional images or video of the weighing platter maybe captured and analyzed to determine whether the user has attempted toresolve the instance of the off-platter condition, e.g., whether theitem is moved or whether the user's hand moved in the vicinity of theoff-platter location.

At block 1206, an image of the item to be purchased may be capturedresponsive to monitoring the weighing platter for instances ofoff-platter conditions. For instance, in some examples, capturing theimage may be based on determining that there are no instances ofoff-platter conditions. Additionally, in some examples, capturing theimage may be based on determining that any detected instances ofoff-platter conditions have been resolved (e.g., corrected by the user,so that the item is now fully resting on the weighing platter). Forinstance, if there are remaining instances of off-platter conditions,the image of the item may not be captured until those instances ofoff-platter conditions are resolved.

At block 1208, the captured image of the item to be purchased may beanalyzed to identify the item. In some examples, the item may becompletely identified based on analyzing the captured image. Forinstance, the captured image may be analyzed to determine that the itemis an apple. In other examples, the item may be partially identified,and/or the possible identifications for the item may be narrowed to twoor more possible identifications. For instance, the captured image maybe analyzed to determine that the item is likely either a lemon or alime.

At block 1210, an indication of the identification (or multiple possibleidentifications) of the item may be sent to the POS system. In examplesin which there are two or more possible identifications for the item,the POS system may display these possible identifications via a userinterface, where a user may select which of the possible identifieditems is the item is to be purchased. For instance, the POS system maycalculate a price for the item based on receiving the identification ofthe item (i.e., either directly based on the analysis of the image, orbased on a selection by the user), using the most recent weight measuredby the weighing platter at the time when the indication of theidentification of the item is received. Accordingly, because the imageof the item to be purchased is captured in response to determining thatthere are no instances of off-platter conditions remaining, the mostrecent weight measured when the POS system receives the indication ofthe identification of the item (determined based on the captured image)is likely a stable weight for the item, i.e., because any off-platterconditions have already been resolved.

FIG. 13 illustrates a block diagram of an example process 1300 as may beimplemented by the system of FIG. 1 , for improving the effectiveness ofan off-platter detection system based on input from an objectrecognition system indicating a priority level associated with an itemto be purchased. One or more steps of the method 1300 may be implementedas a set of instructions stored on a computer-readable memory (e.g.,memory 1116 and/or memory 1122) and executable on one or more processors(e.g., processors 1114 and/or processors 1120).

At block 1302, the weight measured by a weighing scale or weighingplatter associated with a POS system may be monitored. The measuredweight may fluctuate as an item to be purchased is placed onto theweighing platter, i.e., depending on whether the item to be purchased isfully resting on the weighing platter or not.

At block 1304, an image of the item to be purchased may be captured.

At block 1306, the captured image of the item may be analyzed toidentify the item to be purchased and determine a priority levelassociated with the item. In some examples, the item may be completelyidentified based on analyzing the captured image. For instance, thecaptured image may be analyzed to determine that the item is an apple.In other examples, the item may be partially identified, and/or thepossible identifications for the item may be narrowed to two or morepossible identifications. For instance, the captured image may beanalyzed to determine that the item is likely either a lemon or a lime.

The priority level associated with the item to be purchased may be basedon various factors, including, e.g., a total price associated with theitem, a price per unit weight associated with the item, whether the itemis a controlled item, such as alcohol, cigarettes, or certainmedications, and/or a high theft potential associated with the item. Forexample, a high theft potential associated with the item may bedetermined based on, e.g., frequent observations of ticket switchingassociated with the item, and/or frequent observations of scan avoidanceassociated with the item. For instance, a higher priced item, or an itemwith a higher price per weight, or a controlled item, or an item with ahigh theft potential, may be assigned a higher priority level than alower priced item, an item with a lower price per unit weight, anon-controlled item, and/or an item with a low theft potential. Ininstances in which there are two or more possible identifications forthe item, the highest priority level of the priority levels associatedwith each respective possible identification may be considered thepriority level associated with the item to be purchased. For instance,if one possible identification for the item has a high priority level,but another possible identification for the item has a low prioritylevel, the item may be assigned a high priority level.

At block 1308, determining the priority level associated with the itemto be purchased may trigger or initiate monitoring the weighing platterfor any instances of off-platter conditions, in which at least a portionof the item is not resting on the weighing platter. For example, whenthe priority level associated with the item to be purchased is above athreshold priority level, the weighing platter may be monitored forinstances of off-platter conditions, but when the priority levelassociated with the item to be purchased is below the threshold prioritylevel, this monitoring of the weighing platter may not be activated ortriggered. That is, for lower-priority items, off-platter conditions maynot affect the ultimate price of the item significantly, and thus, insome cases, it may be more efficient to proceed without monitoring foroff-platter conditions for lower-priority items.

In some examples, if an off-platter condition is detected for ahigher-priority item, a message may be provided to a user of thecheckout station indicating that the user must resolve the off-plattercondition in order to proceed. For instance, the message may be providedvia, e.g., a user interface, a voice instruction over a speaker, anerror beep, an LED flash, etc.

Additionally, some examples, if an off-platter condition is detected fora higher-priority item, an image or video of the weighing platter,and/or an image of the user of the checkout station, may be captured.This image or video may be analyzed to determine a location or directionassociated with the portion of the item to be purchased using the POSsystem that is not resting on the weighing platter, and the messageprovided to the user regarding resolving the off-platter condition mayinclude an indication of the determined location or direction, i.e., sothat the user knows how best to resolve the off-platter condition. Forinstance, the message provided to the user may indicate that the item isfalling off of the weighing platter on the left side, so that the usercan check the left side of the weighing platter and move the item ontothe weighing platter.

In some examples, additional images or video of the weighing platter maybe captured and analyzed to determine whether the user has attempted toresolve the instance of the off-platter condition, e.g., whether theitem is moved or whether the user's hand moved in the vicinity of theoff-platter location.

If the priority level associated with the item triggers or initiatesmonitoring the weighing platter for instances of off-platter conditions,an indication of the identification (or multiple possibleidentifications) of the item may be sent to the POS system based onthere not being any instances of off-platter conditions, or only onceany instances of off-platter conditions are resolved. In some examples,if the priority level associated with the item is below a certainthreshold level, and the weighing platter is not monitored for instancesof off-platter conditions, this step may be skipped, and an indicationof the identification (or multiple possible identifications) of the itemdetermined at block 1306 may be to the POS system without considerationof off-platter conditions or resolutions thereof.

In examples in which there are two or more possible identifications forthe item, the POS system may display these possible identifications viaa user interface, where a user may select which of the possibleidentified items is the item is to be purchased. The POS system may thencalculate a price for the item based on receiving the identification ofthe item (i.e., either directly based on the analysis of the image, orbased on a selection by the user), using the most recent weight measuredby the weighing platter at the time when the indication of theidentification of the item is received.

Accordingly, because the indication of the identification of the item tobe purchased is sent to the POS system in response to determining thatthere are no instances of off-platter conditions remaining (or inresponse to determining that the priority level of the item does notwarrant monitoring for off-platter conditions), the most recent weightmeasured when the POS system receives the indication of theidentification of the item is either a stable weight for the item (i.e.,because any off-platter conditions have already been resolved) or doesnot ultimately affect the price of the item significantly (i.e., becausethe item is lower-priority).

The above description refers to a block diagram of the accompanyingdrawings. Alternative implementations of the example represented by theblock diagram includes one or more additional or alternative elements,processes and/or devices. Additionally or alternatively, one or more ofthe example blocks of the diagram may be combined, divided, re-arrangedor omitted. Components represented by the blocks of the diagram areimplemented by hardware, software, firmware, and/or any combination ofhardware, software and/or firmware. In some examples, at least one ofthe components represented by the blocks is implemented by a logiccircuit. As used herein, the term “logic circuit” is expressly definedas a physical device including at least one hardware componentconfigured (e.g., via operation in accordance with a predeterminedconfiguration and/or via execution of stored machine-readableinstructions) to control one or more machines and/or perform operationsof one or more machines. Examples of a logic circuit include one or moreprocessors, one or more coprocessors, one or more microprocessors, oneor more controllers, one or more digital signal processors (DSPs), oneor more application specific integrated circuits (ASICs), one or morefield programmable gate arrays (FPGAs), one or more microcontrollerunits (MCUs), one or more hardware accelerators, one or morespecial-purpose computer chips, and one or more system-on-a-chip (SoC)devices. Some example logic circuits, such as ASICs or FPGAs, arespecifically configured hardware for performing operations (e.g., one ormore of the operations described herein and represented by theflowcharts of this disclosure, if such are present). Some example logiccircuits are hardware that executes machine-readable instructions toperform operations (e.g., one or more of the operations described hereinand represented by the flowcharts of this disclosure, if such arepresent). Some example logic circuits include a combination ofspecifically configured hardware and hardware that executesmachine-readable instructions. The above description refers to variousoperations described herein and flowcharts that may be appended heretoto illustrate the flow of those operations. Any such flowcharts arerepresentative of example methods disclosed herein. In some examples,the methods represented by the flowcharts implement the apparatusrepresented by the block diagrams. Alternative implementations ofexample methods disclosed herein may include additional or alternativeoperations. Further, operations of alternative implementations of themethods disclosed herein may combined, divided, re-arranged or omitted.In some examples, the operations described herein are implemented bymachine-readable instructions (e.g., software and/or firmware) stored ona medium (e.g., a tangible machine-readable medium) for execution by oneor more logic circuits (e.g., processor(s)). In some examples, theoperations described herein are implemented by one or moreconfigurations of one or more specifically designed logic circuits(e.g., ASIC(s)). In some examples the operations described herein areimplemented by a combination of specifically designed logic circuit(s)and machine-readable instructions stored on a medium (e.g., a tangiblemachine-readable medium) for execution by logic circuit(s).

As used herein, each of the terms “tangible machine-readable medium,”“non-transitory machine-readable medium” and “machine-readable storagedevice” is expressly defined as a storage medium (e.g., a platter of ahard disk drive, a digital versatile disc, a compact disc, flash memory,read-only memory, random-access memory, etc.) on which machine-readableinstructions (e.g., program code in the form of, for example, softwareand/or firmware) are stored for any suitable duration of time (e.g.,permanently, for an extended period of time (e.g., while a programassociated with the machine-readable instructions is executing), and/ora short period of time (e.g., while the machine-readable instructionsare cached and/or during a buffering process)). Further, as used herein,each of the terms “tangible machine-readable medium,” “non-transitorymachine-readable medium” and “machine-readable storage device” isexpressly defined to exclude propagating signals. That is, as used inany claim of this patent, none of the terms “tangible machine-readablemedium,” “non-transitory machine-readable medium,” and “machine-readablestorage device” can be read to be implemented by a propagating signal.

In the foregoing specification, specific embodiments have beendescribed. However, one of ordinary skill in the art appreciates thatvarious modifications and changes can be made without departing from thescope of the invention as set forth in the claims below. Accordingly,the specification and figures are to be regarded in an illustrativerather than a restrictive sense, and all such modifications are intendedto be included within the scope of present teachings. Additionally, thedescribed embodiments/examples/implementations should not be interpretedas mutually exclusive, and should instead be understood as potentiallycombinable if such combinations are permissive in any way. In otherwords, any feature disclosed in any of the aforementionedembodiments/examples/implementations may be included in any of the otheraforementioned embodiments/examples/implementations.

The benefits, advantages, solutions to problems, and any element(s) thatmay cause any benefit, advantage, or solution to occur or become morepronounced are not to be construed as a critical, required, or essentialfeatures or elements of any or all the claims. The claimed invention isdefined solely by the appended claims including any amendments madeduring the pendency of this application and all equivalents of thoseclaims as issued.

Moreover in this document, relational terms such as first and second,top and bottom, and the like may be used solely to distinguish oneentity or action from another entity or action without necessarilyrequiring or implying any actual such relationship or order between suchentities or actions. The terms “comprises,” “comprising,” “has”,“having,” “includes”, “including,” “contains”, “containing” or any othervariation thereof, are intended to cover a non-exclusive inclusion, suchthat a process, method, article, or apparatus that comprises, has,includes, contains a list of elements does not include only thoseelements but may include other elements not expressly listed or inherentto such process, method, article, or apparatus. An element proceeded by“comprises . . . a”, “has . . . a”, “includes . . . a”, “contains . . .a” does not, without more constraints, preclude the existence ofadditional identical elements in the process, method, article, orapparatus that comprises, has, includes, contains the element. The terms“a” and “an” are defined as one or more unless explicitly statedotherwise herein. The terms “substantially”, “essentially”,“approximately”, “about” or any other version thereof, are defined asbeing close to as understood by one of ordinary skill in the art, and inone non-limiting embodiment the term is defined to be within 10%, inanother embodiment within 5%, in another embodiment within 1% and inanother embodiment within 0.5%. The term “coupled” as used herein isdefined as connected, although not necessarily directly and notnecessarily mechanically. A device or structure that is “configured” ina certain way is configured in at least that way, but may also beconfigured in ways that are not listed.

The Abstract of the Disclosure is provided to allow the reader toquickly ascertain the nature of the technical disclosure. It issubmitted with the understanding that it will not be used to interpretor limit the scope or meaning of the claims. In addition, in theforegoing Detailed Description, it can be seen that various features aregrouped together in various embodiments for the purpose of streamliningthe disclosure. This method of disclosure is not to be interpreted asreflecting an intention that the claimed embodiments require morefeatures than are expressly recited in each claim. Rather, as thefollowing claims reflect, inventive subject matter may lie in less thanall features of a single disclosed embodiment. Thus, the followingclaims are hereby incorporated into the Detailed Description, with eachclaim standing on its own as a separately claimed subject matter.

1. An object recognition and weighing apparatus for use with a point ofsale (POS) terminal that is operable to execute a transaction associatedwith a purchase of an item, the object recognition and weighingapparatus comprising: a weigh platter having a first surface extendingin a first transverse plane; a scale configured to measure a weight ofthe item when placed on the surface; an off-platter detection assemblyconfigured to detect an off-platter condition; an object recognitionassembly configured to capture image data associated with the item whenplaced on the surface and, based on the image data that includesnon-barcode data, identify the item as an identified item set, theidentified item set including one or more items selected from apreexisting item database where the one or more items are selected basedsatisfying a predetermined similarity threshold relative to the item; acommunication interface configured to communicate with the POS terminal;a processor in communication with the scale, the off-platter detectionassembly, and the communication interface; and a non-transitorymachine-readable storage medium storing instructions that, when executedby the processor, cause the object recognition and weighing apparatusto, responsive to detecting the off-platter condition, prevent atransmission of the identified item set to the POS terminal until theoff-platter condition is no longer detected, wherein the off-platterdetection assembly is configured to detect the off-platter conditionbased on at least one of (i) a portion of the item resting on a secondsurface off the weigh platter resulting or (ii) at least some portion ofthe item extending beyond a perimeter of the weigh platter.
 2. Theobject recognition and weighing apparatus of claim 1, wherein the POSterminal is configured to calculate a price for each item based on theidentified item set and based on the most recent weight measured by thescale at the time of transmission of the identified item set.
 3. Theobject recognition and weighing apparatus of claim 1, further comprisinga camera configured to capture an image or video of a user, responsiveto the off-platter detection assembly detecting an off-plattercondition.
 4. The object recognition and weighing apparatus of claim 1,wherein the instructions, when executed by the processor, further causethe object recognition and weighing apparatus to provide a message to auser indicating that the user must resolve the off-platter condition inorder to proceed, via one or more of a user interface, a voiceinstruction over a speaker, an error beep, or an LED flash, responsiveto the off-platter detection assembly detecting an off-plattercondition.
 5. The object recognition and weighing apparatus of claim 4,wherein the instructions, when executed by the processor, further causethe object recognition and weighing apparatus to analyze the image dataassociated with the item to determine a location or direction associatedwith the off-platter condition; and wherein the message to the userincludes an indication of the determined location or direction.
 6. Theobject recognition and weighing apparatus of claim 5, wherein theinstructions, when executed by the processor, further cause the objectrecognition and weighing apparatus to analyze the image data associatedwith the item after providing the message to the user, to determinewhether the user has attempted to resolve the off-platter condition. 7.The object recognition and weighing apparatus of claim 6, whereinanalyzing the image data to determine whether the user has attempted toresolve the off-platter condition includes determining one or more of:whether the item is moved or whether a hand of the user moved in thevicinity of the determined location or direction.
 8. An objectrecognition and weighing apparatus for use with a point of sale (POS)terminal that is operable to execute a transaction associated with apurchase of an item, the object recognition and weighing apparatuscomprising: a weigh platter having a first surface extending in a firsttransverse plane; a scale configured to measure a weight of the itemwhen placed on the surface; an object classification identificationsystem configured to detect the item as a high-priority item; anoff-platter detection assembly configured to detect an off-plattercondition; an object recognition assembly configured to capture imagedata associated with the item when placed on the surface and, based onthe image data that includes non-barcode data, identify the item as anidentified item set, the identified item set including one or more itemsselected from a preexisting item database where the one or more itemsare selected based satisfying a predetermined similarity thresholdrelative to the item; a communication interface configured tocommunicate with the POS terminal; a processor in communication with thescale, the off-platter detection assembly, and the communicationinterface; and a non-transitory machine-readable storage medium storinginstructions that, when executed by the processor, cause the objectrecognition and weighing apparatus to: responsive to (i) detecting theitem being the high-priority item and (ii) detecting the off-plattercondition, prevent a transmission of the identified item set to the POSterminal until the off-platter condition is no longer detected, whereinthe off-platter detection assembly is configured to detect theoff-platter condition based on at least one of (i) a portion of the itemresting on a second surface off the weigh platter resulting or (ii) atleast some portion of the item extending beyond a perimeter of the weighplatter.
 9. The object recognition and weighing apparatus of claim 8,wherein the POS terminal is configured to calculate a price for eachitem based on the identified item set and based on the most recentweight measured by the scale at the time of transmission of theidentified item set.
 10. The object recognition and weighing apparatusof claim 8, wherein the item being the high-priority item is based onone or more of: a total price associated with the item, a price per unitweight associated with the item, a high theft potential associated withthe item, or whether the item is a controlled item.
 11. The objectrecognition and weighing apparatus of claim 10, wherein a high theftpotential associated with the item is based on one or more of: frequentobservations of ticket switching associated with the item, or frequentobservations of scan avoidance associated with the item.
 12. The objectrecognition and weighing apparatus of claim 8, wherein the item beingthe high-priority item is based on the higher priority level of thepriority levels associated with each of the items of the identified itemset.
 13. The object recognition and weighing apparatus of claim 8,further comprising a camera configured to capture an image or video of auser, responsive to the off-platter detection assembly detecting anoff-platter condition.
 14. The object recognition and weighing apparatusof claim 8, wherein the instructions, when executed by the processor,further cause the object recognition and weighing apparatus to provide amessage to a user indicating that the user must resolve the off-plattercondition in order to proceed, via one or more of a user interface, avoice instruction over a speaker, an error beep, or an LED flash,responsive to the off-platter detection assembly detecting anoff-platter condition.
 15. The object recognition and weighing apparatusof claim 14, wherein the instructions, when executed by the processor,further cause the object recognition and weighing apparatus to analyzethe image data associated with the item to determine a location ordirection associated with the off-platter condition; and wherein themessage to the user includes an indication of the determined location ordirection.
 16. The object recognition and weighing apparatus of claim15, wherein the instructions, when executed by the processor, furthercause the object recognition and weighing apparatus to analyze the imagedata associated with the item after providing the message to the user,to determine whether the user has attempted to resolve the off-plattercondition.
 17. The object recognition and weighing apparatus of claim16, wherein analyzing the image data to determine whether the user hasattempted to resolve the off-platter condition includes determining oneor more of: whether the item is moved or whether a hand of the usermoved in the vicinity of the determined location or direction.